-
Notifications
You must be signed in to change notification settings - Fork 279
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove system test results upload #7156
Conversation
The API key expired. According to the system tests team, this step is not expected in our workflow. Removing it accordingly.
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 17 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.36.0-SNAPSHOT~70ea2fc170, baseline=1.36.0-SNAPSHOT~b7b9e6991e
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1064145
Total [baseline] (8.544 s) : 0, 8544389
Agent [candidate] (1.062 s) : 0, 1062324
Total [candidate] (8.555 s) : 0, 8555330
section iast
Agent [baseline] (1.169 s) : 0, 1168564
Total [baseline] (8.983 s) : 0, 8982815
Agent [candidate] (1.167 s) : 0, 1167314
Total [candidate] (8.991 s) : 0, 8991178
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.179 s) : 0, 1178990
Total [baseline] (9.007 s) : 0, 9006769
Agent [candidate] (1.177 s) : 0, 1176800
Total [candidate] (8.999 s) : 0, 8999117
section iast_TELEMETRY_OFF
Agent [baseline] (1.173 s) : 0, 1173202
Total [baseline] (8.991 s) : 0, 8990882
Agent [candidate] (1.172 s) : 0, 1171617
Total [candidate] (8.978 s) : 0, 8978240
gantt
title insecure-bank - break down per module: candidate=1.36.0-SNAPSHOT~70ea2fc170, baseline=1.36.0-SNAPSHOT~b7b9e6991e
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (666.317 ms) : 0, 666317
BytebuddyAgent [candidate] (664.81 ms) : 0, 664810
GlobalTracer [baseline] (304.409 ms) : 0, 304409
GlobalTracer [candidate] (304.122 ms) : 0, 304122
AppSec [baseline] (50.021 ms) : 0, 50021
AppSec [candidate] (50.367 ms) : 0, 50367
Logs Intake [baseline] (387.483 µs) : 0, 387
Logs Intake [candidate] (400.137 µs) : 0, 400
Remote Config [baseline] (689.582 µs) : 0, 690
Remote Config [candidate] (664.033 µs) : 0, 664
Telemetry [baseline] (7.556 ms) : 0, 7556
Telemetry [candidate] (7.541 ms) : 0, 7541
section iast
BytebuddyAgent [baseline] (778.4 ms) : 0, 778400
BytebuddyAgent [candidate] (778.352 ms) : 0, 778352
GlobalTracer [baseline] (293.183 ms) : 0, 293183
GlobalTracer [candidate] (293.628 ms) : 0, 293628
AppSec [baseline] (47.16 ms) : 0, 47160
AppSec [candidate] (47.047 ms) : 0, 47047
IAST [baseline] (27.948 ms) : 0, 27948
IAST [candidate] (25.644 ms) : 0, 25644
Logs Intake [baseline] (306.598 µs) : 0, 307
Logs Intake [candidate] (297.405 µs) : 0, 297
Remote Config [baseline] (576.095 µs) : 0, 576
Remote Config [candidate] (584.196 µs) : 0, 584
Telemetry [baseline] (7.681 ms) : 0, 7681
Telemetry [candidate] (8.457 ms) : 0, 8457
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (787.522 ms) : 0, 787522
BytebuddyAgent [candidate] (785.124 ms) : 0, 785124
GlobalTracer [baseline] (295.246 ms) : 0, 295246
GlobalTracer [candidate] (295.594 ms) : 0, 295594
AppSec [baseline] (46.791 ms) : 0, 46791
AppSec [candidate] (46.857 ms) : 0, 46857
IAST [baseline] (27.396 ms) : 0, 27396
IAST [candidate] (24.869 ms) : 0, 24869
Logs Intake [baseline] (1.053 ms) : 0, 1053
Logs Intake [candidate] (303.941 µs) : 0, 304
Remote Config [baseline] (629.161 µs) : 0, 629
Remote Config [candidate] (588.0 µs) : 0, 588
Telemetry [baseline] (6.89 ms) : 0, 6890
Telemetry [candidate] (10.029 ms) : 0, 10029
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (783.004 ms) : 0, 783004
BytebuddyAgent [candidate] (782.105 ms) : 0, 782105
GlobalTracer [baseline] (296.068 ms) : 0, 296068
GlobalTracer [candidate] (296.087 ms) : 0, 296087
AppSec [baseline] (49.734 ms) : 0, 49734
AppSec [candidate] (47.437 ms) : 0, 47437
IAST [baseline] (22.515 ms) : 0, 22515
IAST [candidate] (24.237 ms) : 0, 24237
Logs Intake [baseline] (303.806 µs) : 0, 304
Logs Intake [candidate] (301.692 µs) : 0, 302
Remote Config [baseline] (565.572 µs) : 0, 566
Remote Config [candidate] (559.329 µs) : 0, 559
Telemetry [baseline] (7.568 ms) : 0, 7568
Telemetry [candidate] (7.51 ms) : 0, 7510
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.36.0-SNAPSHOT~70ea2fc170, baseline=1.36.0-SNAPSHOT~b7b9e6991e
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1065750
Total [baseline] (10.438 s) : 0, 10438039
Agent [candidate] (1.059 s) : 0, 1059408
Total [candidate] (10.368 s) : 0, 10367601
section appsec
Agent [baseline] (1.182 s) : 0, 1181654
Total [baseline] (10.498 s) : 0, 10497849
Agent [candidate] (1.183 s) : 0, 1183246
Total [candidate] (10.495 s) : 0, 10494865
section iast
Agent [baseline] (1.165 s) : 0, 1165273
Total [baseline] (10.693 s) : 0, 10693059
Agent [candidate] (1.177 s) : 0, 1177106
Total [candidate] (10.794 s) : 0, 10794031
section profiling
Agent [baseline] (1.258 s) : 0, 1258305
Total [baseline] (10.62 s) : 0, 10619744
Agent [candidate] (1.263 s) : 0, 1262815
Total [candidate] (10.655 s) : 0, 10655001
gantt
title petclinic - break down per module: candidate=1.36.0-SNAPSHOT~70ea2fc170, baseline=1.36.0-SNAPSHOT~b7b9e6991e
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (667.554 ms) : 0, 667554
BytebuddyAgent [candidate] (663.395 ms) : 0, 663395
GlobalTracer [baseline] (304.88 ms) : 0, 304880
GlobalTracer [candidate] (303.358 ms) : 0, 303358
AppSec [baseline] (50.187 ms) : 0, 50187
AppSec [candidate] (49.881 ms) : 0, 49881
Logs Intake [baseline] (398.162 µs) : 0, 398
Logs Intake [candidate] (396.453 µs) : 0, 396
Remote Config [baseline] (678.722 µs) : 0, 679
Remote Config [candidate] (659.701 µs) : 0, 660
Telemetry [baseline] (7.526 ms) : 0, 7526
Telemetry [candidate] (7.485 ms) : 0, 7485
section appsec
BytebuddyAgent [baseline] (676.259 ms) : 0, 676259
BytebuddyAgent [candidate] (677.552 ms) : 0, 677552
GlobalTracer [baseline] (297.869 ms) : 0, 297869
GlobalTracer [candidate] (298.555 ms) : 0, 298555
AppSec [baseline] (153.029 ms) : 0, 153029
AppSec [candidate] (153.08 ms) : 0, 153080
Logs Intake [baseline] (334.805 µs) : 0, 335
Logs Intake [candidate] (335.042 µs) : 0, 335
Remote Config [baseline] (638.557 µs) : 0, 639
Remote Config [candidate] (639.7 µs) : 0, 640
Telemetry [baseline] (8.171 ms) : 0, 8171
Telemetry [candidate] (8.213 ms) : 0, 8213
IAST [baseline] (21.763 ms) : 0, 21763
IAST [candidate] (20.559 ms) : 0, 20559
section iast
BytebuddyAgent [baseline] (777.631 ms) : 0, 777631
BytebuddyAgent [candidate] (783.993 ms) : 0, 783993
GlobalTracer [baseline] (292.765 ms) : 0, 292765
GlobalTracer [candidate] (295.844 ms) : 0, 295844
AppSec [baseline] (46.886 ms) : 0, 46886
AppSec [candidate] (47.387 ms) : 0, 47387
Logs Intake [baseline] (297.833 µs) : 0, 298
Logs Intake [candidate] (309.107 µs) : 0, 309
Remote Config [baseline] (581.866 µs) : 0, 582
Remote Config [candidate] (609.257 µs) : 0, 609
Telemetry [baseline] (7.672 ms) : 0, 7672
Telemetry [candidate] (9.902 ms) : 0, 9902
IAST [baseline] (26.225 ms) : 0, 26225
IAST [candidate] (25.726 ms) : 0, 25726
section profiling
ProfilingAgent [baseline] (96.56 ms) : 0, 96560
ProfilingAgent [candidate] (95.805 ms) : 0, 95805
BytebuddyAgent [baseline] (660.146 ms) : 0, 660146
BytebuddyAgent [candidate] (664.18 ms) : 0, 664180
GlobalTracer [baseline] (385.69 ms) : 0, 385690
GlobalTracer [candidate] (386.716 ms) : 0, 386716
AppSec [baseline] (51.071 ms) : 0, 51071
AppSec [candidate] (50.922 ms) : 0, 50922
Logs Intake [baseline] (332.159 µs) : 0, 332
Logs Intake [candidate] (333.356 µs) : 0, 333
Remote Config [baseline] (727.345 µs) : 0, 727
Remote Config [candidate] (750.795 µs) : 0, 751
Telemetry [baseline] (7.33 ms) : 0, 7330
Telemetry [candidate] (7.395 ms) : 0, 7395
Profiling [baseline] (96.585 ms) : 0, 96585
Profiling [candidate] (95.83 ms) : 0, 95830
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~70ea2fc170, baseline=1.36.0-SNAPSHOT~b7b9e6991e
dateFormat X
axisFormat %s
section baseline
no_agent (1.343 ms) : 1323, 1363
. : milestone, 1343,
appsec (1.721 ms) : 1697, 1744
. : milestone, 1721,
appsec_no_iast (1.721 ms) : 1697, 1746
. : milestone, 1721,
iast (1.492 ms) : 1469, 1515
. : milestone, 1492,
profiling (1.517 ms) : 1492, 1543
. : milestone, 1517,
tracing (1.457 ms) : 1434, 1481
. : milestone, 1457,
section candidate
no_agent (1.35 ms) : 1330, 1369
. : milestone, 1350,
appsec (1.71 ms) : 1686, 1734
. : milestone, 1710,
appsec_no_iast (1.711 ms) : 1686, 1736
. : milestone, 1711,
iast (1.501 ms) : 1479, 1523
. : milestone, 1501,
profiling (1.47 ms) : 1446, 1494
. : milestone, 1470,
tracing (1.459 ms) : 1434, 1483
. : milestone, 1459,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.36.0-SNAPSHOT~70ea2fc170, baseline=1.36.0-SNAPSHOT~b7b9e6991e
dateFormat X
axisFormat %s
section baseline
no_agent (374.534 µs) : 352, 397
. : milestone, 375,
iast (480.982 µs) : 460, 502
. : milestone, 481,
iast_FULL (562.555 µs) : 541, 584
. : milestone, 563,
iast_GLOBAL (508.445 µs) : 486, 531
. : milestone, 508,
iast_HARDCODED_SECRET_DISABLED (486.832 µs) : 465, 508
. : milestone, 487,
iast_INACTIVE (459.964 µs) : 438, 482
. : milestone, 460,
iast_TELEMETRY_OFF (478.06 µs) : 457, 499
. : milestone, 478,
tracing (450.155 µs) : 428, 472
. : milestone, 450,
section candidate
no_agent (371.012 µs) : 350, 392
. : milestone, 371,
iast (480.806 µs) : 460, 502
. : milestone, 481,
iast_FULL (557.044 µs) : 536, 578
. : milestone, 557,
iast_GLOBAL (502.614 µs) : 482, 524
. : milestone, 503,
iast_HARDCODED_SECRET_DISABLED (480.422 µs) : 460, 501
. : milestone, 480,
iast_INACTIVE (459.087 µs) : 437, 481
. : milestone, 459,
iast_TELEMETRY_OFF (473.383 µs) : 453, 494
. : milestone, 473,
tracing (438.688 µs) : 418, 460
. : milestone, 439,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~70ea2fc170, baseline=1.36.0-SNAPSHOT~b7b9e6991e
dateFormat X
axisFormat %s
section baseline
no_agent (1.458 ms) : 1446, 1469
. : milestone, 1458,
appsec (2.187 ms) : 2154, 2221
. : milestone, 2187,
iast (1.954 ms) : 1914, 1995
. : milestone, 1954,
iast_GLOBAL (1.999 ms) : 1959, 2040
. : milestone, 1999,
profiling (2.319 ms) : 2137, 2500
. : milestone, 2319,
tracing (1.814 ms) : 1783, 1845
. : milestone, 1814,
section candidate
no_agent (1.458 ms) : 1446, 1469
. : milestone, 1458,
appsec (2.198 ms) : 2164, 2232
. : milestone, 2198,
iast (1.96 ms) : 1919, 2001
. : milestone, 1960,
iast_GLOBAL (1.99 ms) : 1948, 2031
. : milestone, 1990,
profiling (1.836 ms) : 1801, 1870
. : milestone, 1836,
tracing (1.82 ms) : 1788, 1851
. : milestone, 1820,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.36.0-SNAPSHOT~70ea2fc170, baseline=1.36.0-SNAPSHOT~b7b9e6991e
dateFormat X
axisFormat %s
section baseline
no_agent (14.916 s) : 14916000, 14916000
. : milestone, 14916000,
appsec (14.948 s) : 14948000, 14948000
. : milestone, 14948000,
iast (18.895 s) : 18895000, 18895000
. : milestone, 18895000,
iast_GLOBAL (17.859 s) : 17859000, 17859000
. : milestone, 17859000,
profiling (15.225 s) : 15225000, 15225000
. : milestone, 15225000,
tracing (14.995 s) : 14995000, 14995000
. : milestone, 14995000,
section candidate
no_agent (14.775 s) : 14775000, 14775000
. : milestone, 14775000,
appsec (15.178 s) : 15178000, 15178000
. : milestone, 15178000,
iast (18.673 s) : 18673000, 18673000
. : milestone, 18673000,
iast_GLOBAL (17.624 s) : 17624000, 17624000
. : milestone, 17624000,
profiling (14.987 s) : 14987000, 14987000
. : milestone, 14987000,
tracing (15.031 s) : 15031000, 15031000
. : milestone, 15031000,
|
Forcibly merging the PR as another PR (#7157) is required to make the CI healthy again |
What Does This Do
This PR removes system tests results upload.
Motivation
The API key expired.
According to the system tests team, this step is not expected in our workflow. Removing it accordingly.
Additional Notes
Jira ticket: [PROJ-IDENT]